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SPECIFICATION 



COMMUNICATION SYSTEM, COMPUTER PROGRAM EXECUTION DEVICE, 
RECORDING MEDIUM, COMPUTER PROGRAM, PROGRAM INFORMATION 
5 SUPPLY METHOD, AND PROGRAM INFORMATION EDITING METHOD 



FIELD OF THE INVENTION 

This invention concerns a communication system by which information is 
exchanged via a network, a computer program execution device used on the user side in 
10 said communication system, a recording medium on which are recorded computer 
programs and data to be used by said communication system, a computer program itself 
for realizing said communication system, a method for supplying program information to 
be transmitted to users via a communication system, and an editing method for said 
program information. 

15 

BACKGROUND OF THE INVENTION 

As information devices (entertainment systems) such as entertainment devices that 
include video game machines, there are those that allow one to play games by 
manipulating operation devices while causing to be displayed on the screen of a television 
20 receiver the content of the game, which is stored on a recording medium such as a 
CD-ROM. 

The entertainment device and operation device in such an entertainment system 
are usually connected by a serial interface. When a clock (pulse) is sent from the 
entertainment device, key switch information, etc. that corresponds to operations by the 
25 user with respect to said operation device operations is sent to the entertainment device 
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synchronized to the clock (pulse). 

Recently, operation devices have been equipped with built-in vibration generation 
means, i.e. tactile feedback, to provide vibration to the user upon request from outside (for 
example, from the entertainment device), so as to give the user various types of tactile 
5 feedback in response to user operations, for example, during the course of playing a game. 

The spread of networks (such as the Internet, for example) has made it simple for 
users to extract, via their computers, information distributed from a server, and to 
conveniently send text to recipients using e-mail. Of course, a user can not only receive 
information but also provide information to a server, for example in the form of 
10 submitting an article. 

Such widespread use of networks makes it simple and speedy to obtain 
information, allowing users to obtain, as text data or image data, various information from 
countries all over the world while remaining at home or at the office. 

Obtaining information via a network is done by connecting the user-side computer 
15 to the network. If the information is text data only, a short-duration connection suffices, 
but if the information is image data or audio data, a long-duration connection is necessary 
in order to take in such information. Because of this, there is the problem that the user is 
tied down to his computer for a long time, and the communication expenses grow large as 
well. 

20 Examples have been proposed in which the connection between the user-side 

computer and the network is made of short duration, and in the short-duration connection 
information is received from the server and information from the user is transmitted (for 
example, see unexamined patent HI 1-46193 [1999] and unexamined patent H9-269923 
[1997]). 

25 Also, examples have been proposed in which if information obtained from a 
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server via the network is to be reported to the user, and is conveyed via characters 
displayed on a monitor (for example, see unexamined patent HI 1-242546 [1 999]). 

Heretofore, if the connection with the server was to be reported to the user, all that 
was done was, for example, to display a message such as "Connected" on the monitor, 
5 which is uninteresting. 

In addition, information conveyed via cartoon-like characters is exclusively the 
content of an e-mail transmitted to the user and is not information for the submission of 
user-contributed articles sent to the server. There is the problem that in order to see this 
contributed information, it is necessary to continue to maintain the connection to the 
10 server, which requires communication expenses as stated above. Moreover, the 
contributed content is displayed in a state when it has been almost entirely input, which is 
uninteresting. 

In other words, heretofore it has been a concept of transferring to the user side and 
viewing information from the server in an exchange of information between individuals, 
15 such as e-mail, but if one is to see the contributed information of users, one usually has to 
go to the server to see it. 

SUMMARY OF THE INVENTION 

The purpose of this invention, which was devised in consideration of such 
20 problems, is to provide a communication system, a computer program execution device, a 
recording medium, and a computer program that make it possible to confirm contributed 
information from users collected in a server in a state where the connection with the 
server is interrupted and via a program in which various characters appear, thereby 
making it possible to build a new program distribution mode using a network. 
25 Another purpose of this invention is to provide a method for supplying program 
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information and a program information editing method that make it possible to build a 
new program distribution mode using a network. 

The present invention comprises a server that is connected to a network, and a 
computer program execution device that can be accessed to said server via said network 
5 and to which at least a display device is connected. Said computer program execution 
device has a program processing means that accesses said server and performs at least a 
first access processing that receives information for constituting a series of programs, and 
a second access processing for sending user contributed information. 

In addition, the present invention fiirther comprises, a computer program 
10 execution device that can be accessed to a server via network and to which at least a 
display device is connected, a program processing means that accesses said server and 
performs at least a first access processing that receives information for constituting a 
series of programs and a second access processing for sending user contributed 
information. 

15 Furthermore, the present invention being a recording medium on which are 

recorded a computer program and data to be used in an entertainment device that can be 
accessed to a server via network, said program has a program processing step that 
accesses said server and performs at least a first access processing that receives 
information for constituting a series of programs and a second access processing for 

20 sending user contributed information. 

In addition, the present invention fiirther comprises a computer-readable 
and -executable computer program used in a computer program execution device that can 
be accessed to a server via network, which has a program processing step that accesses 
said server and performs at least a first access processing that receives information for 

25 constituting a series of programs and a second access processing for sending user 
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contributed information. 

Said program processing means (step) may be made so that the connection with 
the server is interrupted at the stage in which said first access processing has ended and at 
the stage in which said second access processing has ended. 
5 In this way, first, via the first access processing, the computer program execution 

device that is set up at each user receives from the server at least information for 
constituting a series of programs. At each user, at the stage in which said first access 
processing has ended, the connection with the server is interrupted, and based on the 
information that has been received, a series of programs is constituted and is displayed on 
10 the display device. 

Each user can know the contributed content of each user via the lines of dialog 
and placards of various characters that appear in a series of programs displayed on a 
display device. 

If a user has information he wishes to contribute, he can transfer his contributed 
1 5 information to the server via the second access processing while the series of programs is 
continuing or after it ends. Of course, the connection with the server is interrupted at the 
stage in which the second access processing has ended. 

Thus, in accordance with the teachings of the present invention, it is possible to 
confirm (to gen up) contributed information from users collected in a server in a state 
20 where the connection with the server is interrupted and via a program in which various 
characters appear, thereby making it possible to build a new program distribution mode 
using a network. 

Said series of programs may be characterized (constituted) by multiple sequences 
having two or more different time widths, in which case the series of programs will 
25 exhibit variety, which will prevent the user from becoming bored. And if the various 
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sequences are prepared so as to have continuity with each other, the series of programs 
can be realized as a fixed program. 

The information that constitutes said series of programs may be, for example, 
instruction information that indicates the movement data of the characters that appear in 
the multiple sequences that constitute said series of programs, the order of said multiple 
sequences, and contributed information from each user. The transfer speed of this various 
information can be improved because it can be constituted as text data. And if only the 
parts that change are transferred, the transfer speed can be further increased, and the time 
needed for the first access processing can be shortened. 

Said program processing means (step) may have a program production means 
(step) that produces said series of programs based on information from said server by said 
first access processing, and a program display means (step) that displays on a display 
device the program produced by said program production means (step). If so, said 
program display means (step) may display an opening scene during said first access 
processing and display said series of programs at least at the stage in which said first 
access processing has ended. 

In this way, the user can naturally have empathy for the program without being 
aware of the first access processing by the computer program execution device, and thus 
the irritation of waiting for loading can be eliminated. In addition, contributed 
information that is input at an appropriate time during a program or after a program has 
ended is transferred to the server via the second access processing. 

Thus, in the present invention, in a program composition in which access to the 
server is a mandatory element, the user is allowed to enjoy the program without being 
made aware of this access, and in this way he can be made to contribute to the promotion 
of the development of new program compositions. 
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The communication system of the present invention is further characterized in that 
it transmits a program information file from the server to the user-side computer program 
execution system, and it outputs to the monitor of said computer program execution 
system a program constituted by the information registered in said program information 
5 file and the information held in said computer program execution system. 

Thus information that is mainly text data is ti-ansmitted from the server to each 
user's computer program execution system, and a program can be constituted by 
combining, for example, image data with said information in each user's computer 
program execution system. Because of this, the transfer speed from the server to each 

10 user's computer program execution system can be increased, thereby eliminating the user's 
long wait for information sent from the server. As a result, the effect can be obtained that 
the popularization of program distribution over the network is encouraged. 

The information registered in said program information file may be at least 
information concerning multiple sequences constituting programs and contributed text to 

15 be announced in each sequence, while the information held in said computer program 
execution system may be at least motion data including the conversation output of 
characters that appear in said multiple sequences. In this way, the content of a program 
information file to be transmitted from the server to each user's computer program 
execution system can be made into something that is mostly text data, thus making it 

20 possible to achieve an improved transfer speed of the data from the server to each user's 
computer program execution system. 

In addition, in supplying programs consisting of information registered in program 
information files transmitted from a server to each user's computer program execution 
system and information held in said computer program execution system, the present 

25 invention is characterized in that it has processing that produces object data of multiple 
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characters to be displayed on the monitor of each user's computer program execution 
system, processing that produces movement data for each sequence of said multiple 
characters that appear in the multiple sequences that constitute said program, and 
processing that records on a recording medium distributed to each user the object data of 
5 the produced said multiple characters and movement data for each sequence. 

In this way, first, the object data of multiple characters is produced, and movement 
data for each sequence of multiple characters that appear in multiple sequences is 
produced. The object data and movement data for each sequence is recorded on a 
recording medium that is distributed to each user. 

10 Said recording medium is distributed to each user and is installed on each user's 

computer program execution system. That is, at this stage, the information recorded on 
the recording medium is held in the computer program execution system. 

In other words, large-data-quantity character object data and movement data are 
held in each user's computer program execution system, and in this way it becomes 

15 possible to transmit from the sei-ver to each user's computer program execution system 
information that is mainly text data. Because of this, the transfer speed from the server to 
each user's computer program execution system can be increased, thereby eliminating the 
user's long wait for information sent from the server. As a result, the effect can be 
obtained that the popularization of program distribution over the network is encouraged. 

20 Also, a program is created by combining information transmitted from the server to each 
user's computer program execution system and information that is held in the computer 
program execution system. 

Furthermore, the present invention may further have processing that produces 
multiple background images to be displayed in the multiple sequences that constitute said 

25 program, and processing that records on said recording medium background images 
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selected from the produced multiple background images. 

In this way, in a specified program, the background image can be changed on 
various commemorative days, etc. if background images to which a change is to be made 
on various commemorative days, etc. are stored on the server and the background image 
5 that corresponds to the time is transmitted from the server to each user's computer 
program execution system. Because of this, the user can enjoy a program while being 
aware of a seasonal feeling or the existence of a commemorative day. Because 
background images for each season do not change frequently, they may be held in each 
user's computer program execution system. 

1 0 And because background images unrelated to seasons or commemorative days can 

be recorded on said recording medium, there is no need to transmit all the background 
images, and as a result it is possible to suppress the prolongation of transfer time caused 
by the transmission of background images. 

In transmitting program information files from a server to each user's computer 

1 5 program execution system and editing a program consisting of information registered in 
said program information files and information held in said computer program execution 
system, the present invention further comprises processing that determines the 
combination of multiple sequences that constitute said program and registers information 
on the sequences relating to this combination in a program information file, processing 

20 that selects contributed texts sent from each user and extracts the contributed text to be 
announced in each sequence, and processing that registers the extracted contributed texts 
in the information of the sequence that corresponds to said contributed texts among the 
information of the multiple sequences registered in said program information files. 

In this way, the multiple sequences that constitute the program are determined on 

25 the server side, and information concerning these sequences is registered in the program 
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information file. Also, the contributed texts to be announced are extracted from the 
contributed texts sent from the users, and these texts to be announced are registered in the 
corresponding sequence information. 

The program information file in which the various information is registered as 
described above is transmitted from the server to each user's computer program execution 
system. On the side of each user, the program is composed and displayed on the monitor 
based on information concerning sequences registered in the received program 
information file, and in each sequence the corresponding contributed text is announced 
(displayed). 

Thus, the present invention makes it possible to build a new mode of program 
distribution using a network. 

Furthermore, when registering said extracted contributed texts in the information 
of the sequence that corresponds to said contributed texts among the information of the 
multiple sequences registered in said program information file, the feeling that can be 
judged from said contributed text may be made into flag information and registered 
together with said contributed text. 

Thus, when announcing a contributed text at each user, it is possible to announce 
it together with the feeling based on said flag information. Because of this, rather than 
simply presenting a contributed text, if the contributed text is for example of a happy 
content, it is possible for example to make a sequence content in which the characters that 
appear in the sequence present contributed texts enjoyably, and thus one can put together 
a program that one does not grow tired of There is the further advantage of being able to 
make the user more aware of the contributions, thus encouraging the submission of 
contributions. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a composition diagram showing a communication system relating to 
the present invention. 

Figure 2 is a composition diagram showing an entertainment system relating to the 
present invention. 

Figure 3 is a block diagram showing the circuit composition of an entertainment 
system of the present invention. 

Figure 4 shows the connection relationships of a server installed at the site, a 
computer for program information editing, and various databases. 

Figure 5 is an explanatory diagram showing the itemization of a program 
information file. 

Figure 6 is an explanatory diagram showing the itemization of sequence 
information. 

Figure 7 is an explanatory diagram showing the composition of a program. 
Figure 8 is an explanatory diagram showing one shot of a scene comprising the 
first sequence. 

Figure 9 is an explanatory diagram showing another shot of a scene comprising 
the first sequence. 

Figure 10 is an explanatory diagram showing still another shot of a scene 
comprising the first sequence. 

Figure 11 is an explanatory diagram showing still another shot of a scene 
comprising the first sequence. 

Figure 12 is an explanatory diagram showing four representative scenes among 
the scenes that comprise the second sequence. 

Figure 13 is a composition diagram showing the system when it supplies a 
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program. 

Figure 14 is a process block diagram showing program information supply 
processing. 

Figure 15 is an explanatory diagram showing the itemization of the fixed text 
5 information table. 

Figure 16 is an explanatory diagram showing the itemization of the movement 
data table. 

Figure 17 is an explanatory diagram showing the itemization of the conversation 
attributes flag. 

10 Figure 18 is an explanatory diagram showing the method for storing movement 

data files in the movement data database. 

Figure 19 is an explanatory diagram showing the itemization of the conversation 
information. 

Figure 20 is an explanatory diagram showing the itemization of the feelings flag. 
15 Figure 21 is the first part of a process block diagram showing the program 

information editing processing. 

Figure 22 is the second part of a process block diagram showing the program 
information editing processing. 

Figure 23 is a functional block diagram showing the composition of a program 
20 processing means in accordance with this embodiment. 

Figure 24 is a flowchart showing the processing operation of a program 
processing means in accordance with this embodiment. 

Figure 25 is an explanatory diagram showing an example of the menu displayed 
on the monitor screen. 

25 Figure 26 is a flowchart showing the processing operation of the first access 
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processing means. 

Figure 27 is a flowchart showing the processing operation at the server. 

Figure 28 is an explanatory diagram showing the itemization of the present points 

table. 

5 Figure 29 is the first part of a flowchart showing the processing operation of the 

program production and output means. 

Figure 30 is the second part of a flowchart showing the processing operation of 
the program production and output means. 

Figure 3 1 is the third part of a flowchart showing the processing operation of the 
1 0 program production and output means. 

Figure 32 is the fourth part of a flowchart showing the processing operation of the 
program production and output means. 

Figure 33 is a flowchart showing the submenu processing. 

Figure 34 is a flowchart showing the processing operation of the contributed text 
1 5 editing means. 

Figure 35 is a flowchart showing the processing operation of the second access 
processing means. 

Figure 36 is the first part of a flowchart showing the processing operation of the 
present processing means. 
20 Figure 37 is the second part of a flowchart showing the processing operation of 

the present processing means. 

Figure 38 is the third part of a flowchart showing the processing operation of the 
present processing means. 

Figure 39 is an explanatory diagram showing an example of the display of a state 
25 in which a character rejoices. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The following detailed description is of the best mode or modes of the invention 
presently contemplated. Such description is not intended to be understood in a limiting 
5 sense, but to be an example of the invention presented solely for illustration thereof, and 
by reference to which in connection with the following description and the 
accompanying drawings one skilled in the art may be advised of the advantages and 
construction of the invention. In the various views of the drawings, like reference 
characters designate like or similar parts. 
10 As shown in Figure 1, communication system 100 of the present invention has 

server 104 connected to network 102, and multiple entertainment systems 10 that can be 
accessed via said server 104 and network 1 02. 

In the following description, the station at which server 104 is installed is called 
site 106. In the present embodiment, said network 102 is the Internet, and said server 104 
15 is a prescribed website (a web server having a home page). The arrangement is such that 
a user connected to this Internet 102 can view Internet 102 information in hypertext 
format via the www (World Wide Web). 

As shown in Figure 2, entertainment system 10 consists basically of entertainment 
device 12, which executes various computer programs, memory card 14, which can freely 
20 be attached to and detached from said entertainment device 12, operation device 
(controller) 16, which can be freely attached to and detached from entertainment device 
12 and monitor (display device: display) 18, which is a television receiver or other display 
device to which are supplied video and audio signals from entertainment device 12. 

Entertainment device 12 is for reading computer programs recorded on a 
25 high-capacity recording medium, such as a CD-ROM or DVD-ROM or other optical disk 
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20, and executing games, etc. according to instructions from the user (for example, game 
players). Execution of a game means mainly receiving input from controller 16 via 
connector 15 and controlling the progress of the game while controlling the display and 
sound on monitor 18. 

As shown in Figure 2, entertainment device 12 of the present invention has the 
shape of flat rectangular parallelepipeds piled atop one another. Arranged on the front 
panel of entertainment device 12 are disk tray (disk mounting unit) 22, into which a 
recording medium (optical disk) 20 having a computer program and related data is 
mounted and which moves frontward and rearward, reset switch 24 for arbitrarily 
resetting, etc. a computer program, etc. currently in the midst of execution, open button 26 
for pulling out disk tray 22, two insertion openings 30 for memory cards 14 and two 
controller terminals 32, etc. into which connector 15 of controller 16 is inserted. 
Arranged on the rear surface of entertainment device 12 are power switch 28 and an AV 
(audio-visual) multi-output terminal (not shown), etc., which is an output terminal for 
video and audio and is attached to monitor 1 8 via an AV cable. 

Entertainment device 12 contains control functions to read and execute computer 
programs from optical disk 20 or other recording medium on which are recorded said 
computer programs and data for a computer game (video game), and to display characters 
and scenes on monitor 18. Device 12 also has built in various control frinctions such as 
playback of images by DVD (digital versatile disk), which is another optical disk 20, and 
playback of music by CDDA (compact disk digital audio). Entertainment device 12 also 
has the fijnction of executing computer programs obtained by communication via a 
communication network, etc. Displayed on monitor 18 as a display device during 
execution of a computer program for a video game are three-dimensional computer 
graphics video generated by entertainment device 12. 
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In the device 12 of the invention, signals from controller 16 are also processed by 
one of said control functions of entertainment device 12, and its content is reflected in, for 
example, the movement of characters or the svv'itching of scenes on the screen of monitor 
18. 

On controller 16, first and second operation units 51 and 52 are provided left and 
right in the middle of the upper surface, third and fourth operation units 53 and 54 are 
provided on its side surface, and provided left and right on the near side of its upper 
surface are left-side rotation operation stick 70 and right-side rotation operation stick 72 
(which are both joysticks) for performing analog operations. 

First operation unit 51 is a pressing operation unit for, for example, imparting 
movements to characters, etc. displayed on the screen of monitor 18, and its functions are 
set by a computer program, etc. recorded on optical disk 20. First operation unit 51 
consists of four operation keys (direction keys) 51a, 51b, 51c, 5 Id that have the functions 
of moving a character, etc. up, down, left, right, etc. Direction key 51a is also called the 
upward key, direction key 51b is also called the downward key, direction key 51c is also 
called the leftward key, and direction key 51d is also called the rightward key. 

Second operation unit 52 has four cylindrical operation buttons 52a, 52b, 52c, 52d 
for pressing operation with identification marks "A", "O", "x", "□" are attached to the tops 
of operation buttons 52a-52d, respectively. 

Operation buttons 52a-52d are also called, respectively, A (triangle) button 52a, O 
(circle) button 52b, x (cross) button 52c, and □ (square) button 52d. 

The functions of operation buttons 52a-52d of this second operation unit 52 are set 
by computer programs, etc. recorded on optical disk 20. For example, fiinctions such as 
moving the left arm, right arm, left leg, and right leg of a character, etc. and assigned to 
operation buttons 52a-52d. 
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Third and fourth operation units 53 and 54, which have the same structure, each 
have operation buttons for pressing operation aligned two each on top and bottom, i.e., 
operation button (LI button) 53a and operation button (L2 button) 53b, as well as 
operation button (Rl button) 54a and operation button (R2 button) 54b. The functions of 
5 these third and fourth operation units 53 and 54 are likewise set by computer programs 
recorded on optical disk 20, such as the function of causing a character to perform special 
movements. 

Left-side rotation operation stick 70 and right-side rotation operation stick 72 each 
have a signal input element such as a variable resistor that can rotate 360° about the 

10 operation axis, and an analog value is output in correspondence with the tilt. Left- and 
right-side rotation operation sticks 70 and 72 return to their central position by elastic 
members (not shown). By pressing left- and right-side rotation operation sticks 70 and 72 
downward, a signal separate from the analog value associated with the tilt of left- and 
right-side rotation operation sticks 70 and 72 is output. In other words, left- and right-side 

15 rotation operation sticks 70 and 72 have the functions of operations buttons (L3 button) 
70a and (R3 button) 72a as fifth and sixth operation units for pressing operation. 

By rotating and tilting left- and right-side rotation operation sticks 70 and 72, one 
can input command signals that make it possible to perform analog movements such as 
causing characters, etc. to rotate as they move, or vary their speed as they move, or 

20 change their shapes. 

In Figure 2, left- and right-side rotation operation sticks 70 and 72 can be used by 
switching (alternatively) between aforesaid first and second operation units 51 and 52. 
This switching is done by analog mode switch 74. When left- and right-side rotation 
operation sticks 70 and 72 are selected by analog mode switch 74, display unit 76 flashes 

25 to display the selection state of left- and right-side rotation operation sticks 70 and 72. 
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Besides the foregoing, controller 16 also has start button (start switch) 78, which 
indicates the start of a game, etc., and selector button (selector switch) 80, which selects 
the game's degree of difficulty, etc. 

Next, referring to Figure 3, the internal composition and general operation of 
5 entertainment device 12 shown in Figure 2 will now be described. 

Entertainment device 12 has CPU 401, which controls said entertainment device 
12, and connected to this CPU 401 are RAM 402 as a semiconductor memory and bus 
403. 

Connected to said bus 403 are graphic synthesizer (GS) 404 and input-output 
10 processor (lOP) 409. Included in GS 404 are RAM (image memory) 405, which includes 
a frame buffer, Z buffer, and texture memory, etc., and rendering engine 406, which has 
rendering functions that include the function of drawing to the frame buffer in this image 
memory 405. Monitor 18 as external equipment is connected to this GS 404 via encoder 
407 for, for example, converting digital RGB signals, etc. to the NTSC-standard television 
15 system. 

Connected to lOP 409 are driver 410 for playing and decoding data recorded on 
optical disk 20, sound generation system 412, memory card 14 as external memory that 
consists of flash memory, controller 16, ROM 416, on which is recorded the operating 
system, etc., and second driver 420 for accessing data with respect to hard disk 418. 

20 Sound generation system 412 is connected via amplifier 413 to speaker 414 and monitor 
18 as external equipment, and supplies audio signals thereto. 

Sound generation system 412 has sound processing device (sound processing unit: 
SPU) 420, which generates music and sound effects, etc. based on instructions from CPU 
401, and sound buffer 424, which stores the music and sound effects, etc. generated by 

25 this SPU 422. The signals of the music and sound effects, etc. generated by SPU 422 are 
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supplied to the audio terminals of speaker 414 and monitor 18, and in this way music and 
sound effects, etc. are output (emitted) from said speaker 414 and monitor 18. 

In the present invention, SPU 422 has an ADPCM (Adaptive Differential Pulse 
Code Modulation) decoding function, which generates audio data in which, for example, 
5 16-bit audio data is adaptive ly encoded as 4-bit difference signals, a playback function 
that plays back the waveform data stored in sound buffer 424 and a modulation function, 
which modulates and plays back the waveform data stored in sound buffer 424. 

By having such functions, sound generation system 412 can be used as a so-called 
sampling sound source, which generates music and sound effects, etc. based on waveform 
10 data recorded in sound buffer 424 under instructions from CPU 401 . 

Memory card 14 is a card-type external memory device that consists of, for 
example, a CPU or gate array and flash memory. Through its insertion opening 30, 
memory card 14 can be freely attached to and detached from entertainment device 12, and 
stored on this memory card 14 are the intermediate state of games, and programs, etc. for 
15 DVD playback. 

Controller 16 is for giving entertainment device 12 commands (two-value 
commands or multi-value commands) by pressing multiple buttons provided thereon. 
Also, first driver 410 has a decoder for decoding images encoded based on the MPEG 
(Moving Picture Experts Group) standards. 
20 Next, we describe how images are displayed on monitor 18 by operation of 

controller 16. As a premise, it is assumed that object data consisting of polygon vertex 
data, texture data, etc. recorded on optical disk 20 is read via first driver 410 and is held in 
RAM 402 of CPU 401. 

When instructions from the user are input to entertainment device 12 via 
25 controller 16, based on these instructions CPU 401 computes the position of objects in 
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three dimensions (3D) and their orientation with respect to the viewpoint. Thus the 
polygon vertex data of an object defined by the X, Y, Z values of three orthogonal axes is 
changed. The post-change polygon vertex data is transformed by perspective 
transformation processing into two-dimensional coordinate data. 
5 The region prescribed by the two-dimensional coordinates is a so-called polygon. 

The post-transformation two-dimensional coordinate data, Z data, and texture data are 
supplied to GS 404. GS 404 performs drawing processing by performing rendering based 
on the post-transformation two-dimensional coordinate data and Z data, and sequentially 
drawing the texture data to image memory 405 (in this case, to the frame buffer). After 
10 the image of one frame completed by this drawing processing is encoded by encoder 407, 
the drawn texture data is supplied to monitor 18 and is displayed as an image on its screen. 

Meanwhile, as shown in Figure 4, installed at site 106 are server 104 and program 
information editing computer 108, and also provided, connected to server 104 and 
program information computer 108, are multiple databases (for example, background 
15 image database 110, program information database 112, contributed text database 114, 
customer control database 116, and scene information database 126). 

Next, we describe, with reference to Figures 5-39, the characteristic function of 
the communication system 100 of the present invention. 

This function is to transmit a program information file from server 104 to each 
20 user's entertainment system 10 and output to monitor 18 of entertainment system 10 a 
program composed by information registered in said program information file and 
information held in each entertainment system 10. 

In realizing this function, the communication system accesses server 104 and 
performs first access processing in which it receives information (program information 
25 files) for constituting at least a series of programs, and second access processing for 
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sending users' contributed information. 

As shown in Figure 5, program information file 200 has texture region TXZ and 
graphic data region GRZ. Registered in texture region TXZ are multiple sequence 
information SQI that constitute said program, contribution user information CUI 
5 concerning contributions, and present user information PUI concerning presents. The 
term "presents," as used herein refers to "gifts," and thus PUI relates to user information 
concerning presents or gifts. Registered in graphic data region GRZ are one or more 
items of background image data BGD. 

Registered in sequence information SQI are one or more items of scene 

10 information SI that constitute said sequence, in the order in which they are to be broadcast. 
As shown in Figure 6, one item of scene information SI consists of information on the 
background image data BGD to be used in the scene (background information BGI), and 
one or more items of character information to appear in said scene (character information 
CI). The details of these items of information are described in detail later. 

15 Here we describe the composition of a program and the supply of program 

information. First, we describe the composition of a program concerning a program of 
one day of the week (for example, Monday), in the example of a case in which its overall 
length is, for example, 15 minutes. As shown in Figure 7, the program consists of the 
combination of opening OP, first sequence SQI, whose broadcast time is the longest, 

20 second sequence SQ2, whose broadcast time is shorter than that of first sequence SQI, 
third sequence SQ3, whose broadcast time is the shortest, and ending ED. Each sequence 
SQI, SQ2, and SQ3 consists of one or more scenes each. 

In the example of the program in Figure 7, it is arranged in the order opening OP, 
first sequence SQI, first third sequence SQ3, first second sequence SQ2, second third 

25 sequence SQ3, second second sequence SQ2, third third sequence SQ3, third second 



SC01049 «» SCEI 18.798 

22 

sequence SQ2, and ending ED. Various such compositions are conceivable, and the 
broadcast times are arbitrary too. 

Taking a loolt at the itemization of sequences SQl, SQ2, and SQ3, first sequence 
SQl, which is a sequence whose broadcast time is, for example, about 5 minutes, is for 
5 example a drama played by characters as shown in Figures 8-11. During this drama, 
every day the background changes, and the clothing of the characters changes as well. 
Figure 8 shows a shot in which characters 210 appear, and Figure 9 shows a shot in which 
characters 210 ride in cardboard car 212 and talk while taking a drive. Figure 10 shows a 
shot in which one of the characters 210 appears like a prince and is playing a historical 

10 drama, and Figure 11 shows a shot in which characters 210 travel along a winter street 
together with snowman 214. In the movement of "talking," what is being said is 
displayed in dialog balloons, and if necessary the audio is output. This is the same in 
second and third sequences SQ2 and SQ3 as well. 

Second sequence SQ2, which is a sequence whose broadcast time is, for example, 

15 about 2 minutes, is a sequence that presents a relatively long contributed text. As shown 
in Figure 12 as an example, this second sequence SQ2 is one in which, for example, one 
character 210 presents contributed text from the user. This Figure 12 shows one sequence 
in which, in first scene SNl, character 210 speaks the first fixed text, such as "Today too 
this many postcards arrived.". In second scene SN2, character 210 says the first half of 

20 the contributed text. In third scene SN3, character 210 says a comment (inserted text) in 
reply to the contributed content and in fourth scene SN4, character 210 says the last half 
of the contributed text. 

This second sequence SQ2 is only an example, and there could be various 
combinations depending on the length and content of the contributed text. For example, 

25 while making the transition from first scene SNl to second scene SN2, three scenes could 
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be newly added, with inserted text "oooo", fixed text "OOOO", and inserted text "oooo". 

Third sequence SQ3, although not shown, is one in which a one-phrase 
contributed text is presented in the form of, for example, a bulletin board. 

Next, we describe, with reference to Figures 13-20, the supply of the 
5 aforementioned program information. As shown in Figure 13, the supply of program 
information is done using program information supply computer 120. Connected to this 
program information supply computer 120 are object data database 122, movement data 
database 124, background image database 110, and scene information database 126. 

As shown in Figure 14, in the supply of program information, first, in step SI, the 
10 object data of the characters 210 that appear in each sequence is produced, and this is 
stored in order in object data database 122. Then, in step S2, background image data 
BGD to be displayed in each sequence is produced. In this case, the processing of step S2 
includes production of background image data BGD by taking and editing a photograph 
or three-dimensional computer graphics (CO). Produced in step S2 are background image 
15 data BGD for each season, background image data BGD corresponding to various 
commemorative days, background image data BGD resembling a major city, etc. The 
produced background image data BGD is successively stored in background image 
database 110. 

Then, in step S3, the multiple scenes that constitute each sequence are produced. 

20 Specifically, one determines for each scene the movements and conversation texts of 
characters 210. In determining the conversation text, one decides the content of the fixed 
text and the place (shot) where the fixed text is to be inserted, as well as the places (shots) 
where the contributed text and inserted text are to be inserted. At this stage, the 
movement data of characters 210 and the information concerning the fixed texts is 

25 completed. The content of the contributed texts and inserted texts is determined by 
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program information editing, which will be described later. 

Then, in step S4, the multiple items of movement data completed by production of 
each scene are organized in the form of a movement data file 220 corresponding to each 
scene (see Figure 16), and these movement data files 220 are sequentially stored in 
5 movement data database 124. Fixed texts consisting of data concerning completed fixed 
texts, that is, text data, is organized in the form of fixed text information table 222 (see 
Figure 15) and is stored in movement data database 124. 

Fixed text information table 222 consists of the arrangement of multiple records as 
shown in Figure 1 5, and a different fixed text is registered for each record. 

1 0 As shown in Figure 1 6, the movement data MVD that comprises a movement data 

file 220 includes data (coordinates, etc.) that indicate the movement of character 210, a 
conversation attributes flag CFL, and a fixed text number, etc. As shown in Figure 17, the 
conversation attributes flag CFL has bit information indicating the presence or absence of 
conversation text, and bit information indicating the start of a conversation. The fixed 

15 text number is, for example, the record number where the fixed text to be output is stored 
among the multiple records that comprise fixed text information table 222. 

If the conversation to be output in the scene is contributed text and inserted text, 
because only one contributed text or inserted text can be registered for one item of scene 
information, the fixed text number is, for example, "FF" in hexadecimal notation. 

20 As shown in Figure 18, among the aforesaid movement data files 220, for the 

movement data file 220 in which is registered the movement data MVD for which the 
fixed text is to be output, only the movement data file 220 in which is registered the 
movement data MVD indicating the normal expression of character 210 is stored in 
movement data database 124. For a movement data file 220 in which is registered the 

25 movement data MVD for which a contributed text or inserted text is to be output, there 
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are available a movement data file 220 in which is registered the movement data MVD 
indicating the normal expression of character 210, and four movement data files 220 
corresponding to joy, anger, sadness, and happiness, and they are stored together in 
movement data database 124. 
5 Registered in the four movement data files 220 corresponding to joy, anger, 

sadness, and happiness are, respectively, movement data MVD indicating the expression 
when character 210 is joyful, movement data MVD indicating the expression when 
character 210 is angry, movement data MVD indicating the expression when character 
210 is sad, and movement data MVD indicating the expression when character 210 is 
10 happy. 

In said step S4, as each scene is produced, scene information SI is stored 
respectively in scene information database 126. As stated above, scene information SI 
consists of background information BGI and one or more items of character information 
CI corresponding to the one or more characters that appear in the scene (see Figure 6). 

1 5 Background information BGI is attributes, etc. that specify the background image 

data BGD to be used. These attributes are codes, etc. that indicate the storage location 
(optical disk 20 or program information file 200). If said code indicates optical disk 20, 
this attribute is a number or address, etc. indicating the recording sequence on optical disk 
20, and if said code indicates program information file 200, this attribute is the address, 

20 etc. where said background image data BGD is stored in the graphic data region GRZ in 
program information file 200. 

Registered as character information CI are at least the object number of said 
character 210, the file attribute that specifies movement data file 220 (a number, or 
identification code, or address, etc. indicating the recording sequence on optical disk 20), 

25 and the conversation information CCI. 
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As shown in Figure 19, conversation information CCI consists of bit information 
indicating whether it is contributed or inserted text or rather fixed text, text data TXD of 
the contributed text or inserted text to be registered if this bit information indicates 
contributed or inserted text, and feelings flag FFL. As shown in Figure 20, feelings flag 
FFL contains four bits of information corresponding to joy, anger, sadness, and happiness, 
and if the contributed text or inserted text is, for example, of happy content, the bit 
information corresponding to "happy" is set to "1". 

In step S5 in Figure 14, in producing a recording medium to be supplied to the 
market, for example optical disk 20 to be mounted on entertainment device 12, as shown 
in Figure 13, the necessary computer program or the prescribed data is recorded on said 
optical disk 20 via formatter 130. The necessary computer program is, for example, a 
computer program that broadcasts a program on monitor 18 according to program 
information file 200 sent from server 104 to each entertainment system 10. Said 
prescribed data is, for example, object data stored in object data database 122 or multiple 
movement data files 220 stored in movement data database 124, or fixed text information 
table 222, etc. Also, said prescribed data is, for example, background image data BGD 
for each season or background image data BGD resembling a major city, that is, 
background image data BGD that can be used widely, not just limited to that day. 

When optical disk 20 on which said computer program and prescribed data are 
recorded is supplied to the market, interested users obtain said optical disk 20 and, for 
example, perform the registration processing of transferring user information to server 
104 via network 102. In this registration processing, if a user ID is issued to said user, 
said user is thereby registered as a legitimate member. The issued user ID is stored in 
customer control database 116 (see Figure 4). 

Next we describe, with reference to Figures 21 and 22, an example of editing of 
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program information done at site 106. As shown in Figure 4, program information editing 
is done using program information editing computer 108. Connected to program 
information editing computer 108 are background image database 110, program 
information database 112, contributed text database 114, customer control database 116, 
and scene information database 126. 

In editing program information, as shown in Figure 21, first, in step Sll, a 
program information file 200 for each day of the week is prepared. Then, in step SI 2, a 
program for each day of the week is produced. 

In this program production, one sequence information SQI is produced by 
combining arbitrary items of scene information SI from the multiple items of scene 
information SI stored in scene information database 126. The background image data 
BGD for each scene information SI is determined according to the season or day of the 
week, etc., and is registered as background information BGI. In this case, if one is to use 
background image data BGD that can be widely used and is not limited to that day only, 
such as background image data BGD of a season or city, etc., background image data 
BGD recorded on optical disk 20 is selected, and on the other hand if one is to use 
background image data BGD for that day only, such as a concert notice or a 
commemorative day, etc., suitable background image data BGD is extracted from 
background image database 110. Then this background image data BGD is registered in 
graphic data region GRZ of program information file 200. 

Then, repeating said operation, as shown in Figure 7, a program is produced in 
which first sequence SQI, second sequence SQ2, and third sequence SQ3 are arranged. 
Then these sequences SQI, SQ2, SQ3 are each registered in their broadcast order in the 
corresponding program information file 200 as multiple items of sequence information 
SQI. At this stage, among the items of scene information SI that constitute each sequence 
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information SQI, only scenes tliat output a fixed text are completed. In step SI 3 in Figure 
21, the produced program information files 200 are sequentially stored in program 
information database 112. 

The processing of aforesaid steps SI 1 -SI 3 need not be done every day, but can be 
5 done, for example, at the stage in which program information changes or on days when 
the season changes. 

Next, we describe the program information editing that is put together at once or is 
done every day. First, in step S21 in Figure 22, the contributed texts to be displayed in 
sequences SQI, SQ2, and SQ3 to be broadcast in, for example, a program the following 
10 day are extracted from the contributed texts stored in contributed text database 114. The 
storage of contributed texts is discussed below. 

Together with this operation of extracting contributed texts, present points for the 
users who transmitted said contributed texts are updated. When these present points reach 
a prescribed value, information is sent to the user informing him that he will be awarded a 
1 5 present. 

Then, in step S22, the figures, etc. are adjusted for the extracted contributed text to 
fit the time width to be displayed, and this is made into the contributed text for display. At 
this time the relevant bits of the feelings flag FFL may be set according to the content of 
the contributed text. As shown in Figure 20, four items of bit information corresponding 

20 to joy, anger, sadness, and happiness are included in this feelings flag FFL. If for example 
the contributed text is of happy content, the bit information corresponding to "happy" is 
set to "1". In this case, the contributed text may be adjusted to a happy content. If no joy, 
anger, sadness, or happiness is to be shown, each bit of the feelings flag FFL is set to "0". 
If necessary, a comment on the extracted text is produced as an inserted text. In 

25 this case too, the relevant bits of feelings flag FFL are set to " 1 " or "0". 
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Then, in step S23, processing is done whereby said extracted contributed text or 
inserted text is registered in program information file 200 as conversation information 
CCI to be output by a specified character 210 in the relevant scene. That is, the 
contributed text or inserted text and the feelings flag FFL are registered as conversation 
information CCI of character information CI with respect to the relevant scene 
information SI in these contributed texts, etc. in the program information file 200 that 
corresponds to the day of the week of the following day. At this time, registration of 
conversation information CCI is achieved while confirming the movement data MVD of 
the relevant scene. 

Then, in step S24, one registers contribution user information CUI concerning the 
contribution and present user information PUI concerning the present with respect to the 
program information file 200 to be transmitted the following day. This contribution user 
information CUI is the user ID of the user who sent the contributed text to be announced 
this time, and this present user information PUI is the user ID and user name of the user 
who has exceeded the prescribed present points, and the name of the present, etc. 
Registered in this present user information PUI as inserted text are the name of the user to 
be given the present and a message presenting it, etc. 

At the stage when the processing in said step 24 ends, for example, editing of 
program information file 200 to be transmitted the following day ends. And in the 
following step S25, this program information file 200 is recorded in the prescribed region 
on a hard disk (not shown) that is connected to server 104, for example in a region 
accessed by a double buffer method, and one waits for transmission to each server. 

Editing of program information is done by repeating aforesaid steps S21-S24. 
This editing processing may be done, for example, once a week all together, or the portion 
for each day may be done once a day. In particular, if the latter method is selected. 
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opinions and impressions from users concerning topical contributed texts and cases arrive 
at each user the following day. This maintains the bulletin nature of the information, 
thereby making it possible to invoke the desire to have a look at the program once a day. 

Next we describe, with reference to Figures 23-39, an example of software 
(program processing means 300) for realizing the aforesaid function, that is, the function 
of transmitting program information file 200 from server 104 to each user's entertainment 
system 10 and outputting on monitor 18 of entertainment system 10 a program consisting 
of information registered in said program information file 200 and information held in 
each entertainment system 10. As stated above, this program processing means is 
provided to entertainment device 12, via a network, from a random-access recording 
medium such as optical disk 20 or memory card 14 or hard disk 418. Here we proceed 
with the description assuming the case in which program processing means 300 runs after 
having been read into entertainment device 12 from optical disk 20. 

Program processing means 300 is operated on CPU 401 by, for example, being 
downloaded into RAM 402 of entertainment device 12 through the prescribed processing 
fi-om a specified optical disk 20 previously played on entertainment device 12. 

As shown in Figure 23, this program processing means 300 has first access 
processing means 302, which accesses server 104 at least through network 102, receives 
program information file 200 transmitted from said server 104, and records it on hard disk 
418, program production and output means 304, which outputs on monitor 18 a program 
that it produces by information of received program information file 200 and information 
recorded on, for example, optical disk 20, program confirmation means 306 for 
confirming a program seen once, contributed text editing means 308, which edits, as 
contributed text, messages input through controller 16, second access processing means 
310, which accesses server 104 at least through network 102 and transmits contributed 
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texts to said server 104, present processing means 312, which displays each user's present 
points and displays present receipt, etc. based on contribution user information CUI and 
present user information PUI registered in program information file 200 and image 
display means 314, which outputs to monitor 18 the image data drawn to image memory 
5 405 and displays said image on the screen of said monitor 18. 

Program production and output means 304 has program production means 320, 
which produces a program by means of the information of received program information 
file 200 and information recorded on, for example optical disk 20 and program drawing 
means 322, which draws to image memory 405 the images of the produced program. The 
1 0 program display means consists of this program drawing means 322 and image display 
means 314. 

Next we describe, with reference to Figures 24-39, the processing operation of the 
program processing means 300. First, in step SlOl in Figure 24, this program processing 
means 300 displays a menu on screen 301 of monitor 18, as shown in Figure 25. 
15 Arranged on this menu are items such as, for example, "1. Today's program", "2. 
Confirmation of already broadcast programs", "3. Contribution submission", "4. Present 
information". 

Next, in step SI 02, one waits for operation input from controller 16. That is, one 
waits for the input of a menu item. Upon operation input, one proceeds to the next step 
20 SI 03 and decides whether the item "1. Today's program" has been selected. If the 
selected item is "1. Today's program", one proceeds to the next step SI 04 and decides 
whether it is a new display. If it is new, one proceeds to the next step SI 05 and enters 
processing by first access processing means 302. 

In this first access processing, first, in step S201 in Figure 26, one displays the 
25 login (request screen for making the connection with server 104) on the screen of monitor 
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18. Then, in step S202, one waits for input of the password via controller 16. Upon input 
of the password, one proceeds to the next step S203 and decides whether the password is 
correct, that is, whether it is the same as the legitimate password previously set by the user. 

If the input password is not correct, one proceeds to step S204, displays an error 
message on the screen of monitor 1 8, returns again to aforesaid step S202, and waits for 
input of a password. Upon input of a correct password, one proceeds to the next step 
S205 and makes the connection with server 104. 

Here we describe, with reference to the flowchart in Figure 27, the processing 
operation of server 104. First, in step S3 01 in Figure 27, server 104 decides whether there 
is any transmission to said server 104, that is, whether reception has been detected. If 
reception is detected, one proceeds to the next step S3 02 and extracts the user ID from the 
received data. 

Next, in step S3 03, one looks up whether said extracted user ID is a user ID that is 
registered in customer control database 116 (see Figure 4), and in the next step S304, one 
decides the lookup results. That is, one looks up whether the sender is a user who is 
legitimately registered with this network service. 

In this step S304, upon deciding that it is a legitimate user, one proceeds to the 
next step S305 and performs normal processing. Specifically, a normal signal is sent to 
said sender. Then, in step S3 06, one decides whether the reception content this time is a 
program transmission request, that is, whether it is access by first access processing 
means 302. 

If it is a program transmission request, one proceeds to the next step S307 and 
transmits to entertainment system 10 of said user the program information file 200 for 
today that has been recorded on the hard disk of server 104. 

In said step S306, if it is not a program transmission request but a contributed text 
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reception request, one proceeds to the next step S308, receives the contributed text sent 
from entertainment system 10 of said user, and stores it in contributed text database 114. 

On the other hand, if in said step S3 04 it is decided that it is not a legitimate user, 
one proceeds to step S309 and performs error processing. Specifically, an error signal is 
sent to the sender, who is not a legitimate user. 

Upon conclusion of the processing in said step S307, step S3 08, or step S309, one 
proceeds to the next step S3 10 and decides whether there is a program termination request 
(power cutoff or forcible termination, etc.) in response to the reception processing by this 
server 104. If there is no program termination request, one returns to aforesaid step S301 
and repeats the processing beginning with said step S301. And upon a program 
termination request, the reception processing by server 104 comes to an end. 

We return to the description of the routine in Figure 26. In the next step S206, it is 
decided whether the connection with server 104 has been made normally. This decision is 
made according to whether a normal signal has been sent from server 104. If an error 
signal rather than a normal signal is sent from server 104, one proceeds to the next step 
S207, displays on the screen of monitor 1 8 an error message such as "Please register as a 
legitimate member.", and forcibly terminates the processing by this program processing 
means 300. 

If in said step S206 it is decided that it is normal, one proceeds to the next step 
S208 and begins display of the opening image, for example an animation image. Next, in 
step S209, one loads the program information file 200 sent from server 104, and in the 
following step S210 one waits for the loading to end. During this time, the opening image 
is displayed on the screen of monitor 18. 

Then, when loading of program information file 200 ends, in step S211, one 
releases the connection with server 104 (logout), and thereafter the processing by this first 
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access processing means 302 ends. 

We return to the description of the main routine in Figure 24. In the next step 
SI 06, program information file 200 received by said first access processing is stored in an 
external memory device, such as memory card 14 or hard disk 418. At this time, said 
5 program information file 200 is stored in an address corresponding to the current date. 

Next, in step SI 07, one reads all the user IDs registered in the contribution user 
information CUI in said program information file 200. Then one updates the present 
points in the records corresponding to said read user IDs in the present points table shown 
in Figure 28. 

10 Next, when the processing in said step SI 07 comes to an end, or if in aforesaid 

step SI 04 it is decided that today's program has already been displayed, one proceeds to 
the next step SI 08 and reads the current date. Specifically, one reads the current date 
from, for example a real-time clock (RTC - not pictured), that is connected to bus 403 of 
entertainment device 12. 

15 Then, in step SI 09, one enters processing by program production and output 

means 304. In the processing by this program production and output means 304, first, in 
step S401 in Figure 29, index register "i," which is used for looking up sequence 
information SQI, is initialized by storing initial value "0" in said index register "i." 

Then, in step S402, by means of program production means 320, one reads the i-th 

20 sequence information irom the program information file 200 corresponding to the 
requested date among the one or more program information files 200 stored in the 
external memory device. This requested date is the current date if one requests today's 
program, and is a date arbitrarily selected by the user fi-om the calendar if one requests 
confirmation of an already broadcast program. 

25 Next, in step S403, one initializes index register "j," which is used for looking up 
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scene information SI, by storing initial value "0" in said index register "j." Then, in step 
S404, by means of program production means 320, one reads the j-th scene information 
from said sequence information SQL 

Next, in step 8405, the background image is determined by means of program 
5 production means 320. Specifically, one reads the background image data BGD stored in 
the location indicated by the attributes from among the background information BGI 
registered in scene information SI. That is, if the code included in said attributes that 
indicates the storage location indicates optical disk 20, then background image data BGD 
is read from the location corresponding to the number or address, etc. in optical disk 20 
10 included in said attributes, and if, on the other hand, the code included in said attributes 
that indicates the storage location indicates a program information file 200, then 
background image data BGD is read from the location in graphic data region GRZ of the 
program information file 200 that corresponds to the number or address, etc. included in 
said attributes. 

15 In step S406, said read-out background image data BGD is drawn to image 

memory 405 by program drawing means 322. 

Next, in step S407, index register "m," which is used for looking up movement 
data, is initialized by storing initial value "0" in said index register "m." Next, in step 
S408, index "k," which is used for looking up character information CI, is initialized by 

20 storing initial value "0" in said index register "k." 

Next, in step S409, the k-th character information CI is read from said scene 
information SI by program production means 320. Then, in step S410, object data that 
corresponds to the object number included in said character information CI is read by 
means of program production means 320 from among the many items of object data 

25 stored on optical disk 20. 
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Next, in step S411 in Figure 30, it is decided wiiether conversation information 
CCI included in said character information CI indicates contributed or inserted text. If it 
indicates contributed or inserted text, in tlie next step S412, the movement data file 200 
that is included in the group corresponding to the movement data file number included in 
5 said character information CI and that corresponds to the content of feelings flag FFL is 
read by means of program production means 320. For example, if all the bit information 
of feelings flag FFL is "0", which indicates "normal", then the movement data file 200 
that indicates "normal" is read from among the five movement data files 220 shown in 
Figure 18, and if the bit information of feelings flag FFL indicates "happy", then the 
10 "happy" movement data file 200 is read from among the five movement data files 220 
shown in Figure 1 8. 

In said step S411, if it is decided that conversation information CCI is a fixed text 
or is without conversation, one proceeds to step S413 and reads, by means of program 
production means 320, the movement data file 220 that corresponds to the movement data 
15 file number included in said character information CI. 

When the processing in said step S412 or the processing in step S413 comes to an 
end, one proceeds to the next step S414 and reads, by means of program production 
means 320, the m-th movement data from said read movement data file 220, then, in step 
S4I5, it is decided whether all of the movement data has been read, that is, whether the 
20 read data is EOD (end of data). 

If the read data is not EOD but is movement data, one proceeds to the next step 
S4I6 and by means of program drawing means 322 rewrites the vertex data of said object 
data based on movement-indicating data (coordinates, etc.) included in said movement 
data. Then, in step S417, a 3D image concerning said character 210 is drawn to image 
25 memory 405 by means of rendering processing. 
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Next, in step S418, it is decided whether there is a conversation in said movement 
data. This decision is made by whether the bit information of the conversation attributes 
flag CFL included in said movement data indicates "there is a conversation". 

If "there is a conversation", one proceeds to the next step S419, and it is decided 
5 whether this time is the start of the conversation. This decision too is made by whether 
the bit information of the conversation attributes flag CFL included in said movement 
data indicates "start of conversation". 

In the case of "start of conversation", one proceeds to step S420 in Figure 31, and 
it is decided whether the conversation this time is a fixed text. If it is a fixed text, one 
10 proceeds to the next step S421, reads the fixed text number from said movement data by 
means of program production means 320, then, in step S422, reads the fixed text that 
corresponds to the fixed text number this time from fixed text information table 222. On 
the other hand, if in aforesaid step S420 it is decided that it is not a fixed text, then in the 
next step S423 one reads this time's contributed text or inserted text from said 
15 conversation information CCI by means of program production means 320. 

When the processing in said step S422 or the processing in step S423 comes to an 
end, one proceeds to the next step S424 and begins output of the audio of said 
conversation text (fixed text, or contributed text or inserted text). In this way, said 
conversation text is emitted from speaker 414 of monitor 18 at approximately the same 
20 time as the image display (including display of the conversation text) in step S428 
discussed below. 

When the processing in said step S424 comes to an end, or if it is decided in step 
S419 that it is in the midst of a conversation, one proceeds to step S425 in Figure 31 and 
draws said conversation text, including dialog balloons, to image memory 405. 
25 When the processing in said step S425 comes to an end, or if it is decided in step 
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S418 that it is without conversation, or if it is decided in step S415 that it is without 
movement data, one proceeds to step S426 and updates the value of index register "Ic" by 
Then, in the next step S427, it is decided whether image drawing processing has 
ended for all characters 210. This decision is made according to whether the value of 
5 index register "k" is greater than or equal to this time's number of characters A. 

If the value of index register "k" is less than the number of characters A, one 
returns to aforesaid step S409 in Figure 29 and performs drawing processing for the next 
character 210, and when the value of index register "k" becomes greater than or equal to 
the number of characters A, one proceeds to step S428 in Figure 31 and outputs to 
10 monitor 1 8 the image data drawn to image memory 405 by means of image display means 
314. 

Next, in step S429, after updating the value of index register "m" by "+1", in the 
next step S430, it is decided whether one scene has ended. 

If the movement display and conversation output for said scene has not come to an 
15 end, one returns to aforesaid step S408 in Figure 29, and the processing beginning with 
said step S408 is performed. That is, drawing based on the next movement data is done 
respectively for all characters. When the movement display and conversation output for 
said scene comes to an end, one proceeds to step S43 1 in Figure 32 and updates the value 
of index register "j" by Then, in the next step S432, it is decided whether one 

20 sequence has come to an end. 

If the movement display and conversation output for said sequence has not come 
to an end, one returns to aforesaid step S404 in Figure 29, and the processing beginning 
with said step S404 is performed. That is, movement display and conversation output for 
all characters is done for the next scene. When the movement display and conversation 
25 output for said sequence comes to an end, one proceeds to step S433 in Figure 32 and 
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updates the value of index register "i" by Then, in the next step S434, it is decided 

whether processing has come to an end for all the sequences that comprise the program 
this time. 

If the movement display and conversation output for all sequences has not come 
5 to an end, one returns to aforesaid step S402 in Figure 29, and the processing beginning 
with said step S402 is performed. That is, movement display and conversation output is 
done for the next sequence. And when the movement display and conversation output for 
all sequences comes to an end, one proceeds to step S435 in Figure 32, displays the 
ending image, for example an animation image, for the prescribed time, and processing by 

10 this program production and output means 304 ends. 

We return to the description of the main routine in Figure 24. In the next step 
SI 03, if it is decided that the selected item is not "1. Today's program", one proceeds to 
step SllO and enters submenu processing. 

In this submenu processing, as shown in Figure 33, in step S501 it is decided 

15 whether the selected item is "2. Confirmation of already broadcast programs". If the item 
is "2. Confirmation of already broadcast programs", one proceeds to the next step S502 
and displays a calendar on the screen of monitor 18. Then, in step S503, one waits for 
operation input from controller 16. That is, one waits for input of the date. Upon 
operation input, one proceeds to the next step S504 and receives the requested date. Then, 

20 in the next step S505, one enters processing by program production and output means 304. 
At this time, if a date farther in the fliture than the present is selected or if a date is 
specified that is prior to this network service being executed, an error message is 
displayed. As this error message, for example an error message is displayed to the effect 
that one should input a date within a specified range. 

25 Processing by program production and output means 304 results in a program 
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concerning the requested date being displayed on the screen of monitor 18. This 
processing has already been described, so it will not be described here. 

If in aforesaid step S501 it is decided that it is not "2. Confirmation of already 
broadcast programs", one proceeds to the next step S506, and it is decided whether the 
5 selected item is "3. Contribution submission". If the item is "3. Contribution submission", 
one proceeds to the next step S507 and enters processing by contributed text editing 
means 308. 

In processing by this contributed text editing means 308, first, in step S601 in 
Figure 34, one displays a screen for contributed text editing on the screen of monitor 18. 
10 Then, in step S602, one waits for operation input form controller 16. That is, one waits 
for input of an item concerning a sequence or of a contributed text. 

Next, in step S603, it is decided whether said operation input is input of an item 
concerning a sequence. If it is an item concerning a sequence, one proceeds to the next 
step S604 and allocates a sequence number that corresponds to the item that has been 
15 input. 

In said step S603, if it is decided that it is not an item concerning a sequence, one 
proceeds to step S605, and it is decided whether it is message input. If it is message input, 
one proceeds to the next step S606 and performs editing of the input message. This 
message editing includes input, correction, and deletion, etc. of the contributed text. Also, 

20 if in said step S605 it is decided that it is not message input, one proceeds to the next step 
S607, and other processing corresponding to the operation input is performed. 

Upon completion of the processing in aforesaid step S604, step S606, or step S607, 
one proceeds to the next step S608, and it is decided whether editing of the contributed 
text has ended. This decision is made by, for example, whether an icon such as "editing 

25 completed", not shown, that is displayed on the screen of monitor 18 has been operated. 



SCO 1049 «» SCEI 18.798 

41 

If editing has not ended, one proceeds to aforesaid step S602 and waits for the 
next operation input. 

When editing has ended, one proceeds to the next step S609 and saves the 
allocated items and input messages (contributed texts) that correspond to these items in a 
5 file for transmission. 

Upon completion of the processing in aforesaid step S609, processing by this 
contributed text editing means 308 comes to an end. 

We return to the description of the routine in Figure 33. In the next step S508, we 
enter processing by second access processing means 310. In the processing by this 
10 second access processing means 310, first, in step S701 in Figure 35, one waits for input 
of a password via controller 16. Upon input of a password, one proceeds to the next step 
S702, and it is decided whether the password that has been input is correct, that is, 
whether the password that has been input is the same as the legitimate password 
previously set by the user. 
15 If the input password is not correct, one proceeds to step S703, displays an error 

message on the screen of monitor 18, returns again to aforesaid step S701, and waits for 
input of a password. Upon input of a correct password, one proceeds to the next step 
S704 and makes the connection with server 104. 

As shown in Figure 27, at server 104, in step S3 03 one looks up whether the 
20 sender is a user legitimately registered with this network service, and upon deciding that 
he is a legitimate user, a normal signal is sent to said sender (step S305). Also, one 
receives the contributed text sent from entertainment system 10 of said user and stores it 
in contributed text database 1 14 (step S308). 

If in step S304 it is decided that he is not a legitimate user, error processing is 
25 done as stated above. 
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We return to the description of the routine in Figure 35. In the next step S705, it is 
decided whether the connection with server 104 has been made normally. This decision is 
made according to whether a normal signal has been sent from server 104. If an error 
signal rather than a normal signal is sent from server 104, one proceeds to the next step 
S706. In this step S706, one displays on the screen of monitor 1 8 an error message such 
as "Please register as a legitimate member.", and forcibly terminates the processing by this 
program processing means 300. 

If in said step S705 it is decided that it is normal, one proceeds to the next step 
S707 and transmits to server 104 the sequence numbers and contributed texts that have 
been saved in the file for transmission. At server 104, as stated above, in step S308 one 
receives the sequence numbers and contributed texts and saves them in contributed text 
database 114. When transmission of said contributed texts, etc. ends, then, in step S708, 
one releases the connection with server 104 (logout), and thereafter the processing by this 
second access processing means 310 ends. 

We return to the description of the routine in Figure 33. If in said step S506 the 
selected item is judged not to be "3. Contribution submission", one proceeds to step S509, 
and this time it is judged whether the selected item is "4. Present information". If it is "4. 
Present information", one proceeds to the next step S510 and enters processing by present 
processing means 312. 

In processing by this present processing means 312, first, in step S801 in Figure 
36, one displays a present points table (see Figure 28) on the screen of monitor 18. In this 
display, user names and points are displayed, and user IDs are in a hidden form. 

Next, in step S802, the object data of a character for present presentation is read 
from optical disk 20. Then, in step S803, movement data file 220 of the character for 
present presentation is read from optical disk 20. 
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Next, in step S804, index register "p," which is used for loolcing up movement 
data, is initialized by storing initial value "0" in said index register "p." 

Next, in step S805, one reads the p-th movement data from said movement data 
file 220, then, in step S806, it is decided whether all of the movement data has been read, 
5 that is, whether the read data is EOD (end of data). 

If the read data is not EOD but is movement data, one proceeds to the next step 
S807 and rewrites the vertex data of said object data based on movement- indicating data 
(coordinates, etc.) included in said movement data. Then, in step S808, a 3D image 
concerning said character is drawn to image memory 405 by means of rendering 
10 processing. 

Next, in step S809, it is decided whether there is a conversation in said movement 
data. This decision is made by whether the bit information of the conversation attributes 
flag CFL included in said movement data indicates "there is a conversation". 

If "there is a conversation", one proceeds to the next step S810, and it is decided 
15 whether this time is the start of the conversation. This decision too is made by whether 
the bit information of the conversation attributes flag CFL included in said movement 
data indicates "start of conversation". 

In the case of "start of conversation", one proceeds to step S811 in Figure 37, and 
it is decided whether the conversation is a fixed text. If it is a fixed text, one proceeds to 
20 the next step S812, reads the fixed text number from said movement data, then, in step 
S813, reads the fixed text that corresponds to the fixed text number this time from fixed 
text information table 222. On the other hand, if in aforesaid step S8 11 it is decided that it 
is not a fixed text, then one reads an inserted text from the present user information PUI in 
the last program information file 200 among the program information files 200 recorded 
25 on hard disk 418. 
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When the processing in said step S813 or step S814 comes to an end, one 
proceeds to the next step S815 and begins output of the audio of said conversation text 
(fixed text or inserted text). In this way, said conversation text is emitted from, for 
example, speaker 414 attached to monitor 18 at approximately the same time as the image 
5 display (including display of the conversation text) in step S817 discussed below. 

When the processing in said step S8i5 comes to an end, or if it is decided in step 
S810 that it is in the midst of a conversation, then in step S816 one draws said 
conversation text, including dialog balloons, to image memory 405. 

When the processing in said step S816 comes to an end, or if it is decided in step 
10 S809 that it is without conversation, then in step S817, by means of image display means 
314, the image data drawn to image memory 405 is output to monitor 18, thereby 
displaying said image data on the screen of monitor 18. Then, in step S818, after 
updating the value of index register "p" by "+1", one returns to the processing beginning 
at step S805 in Figure 36. 
1 5 In said step S806, if it is decided that it is without movement data, one proceeds to 

step S819 in Figure 38 and looks up said user from among the users eligible for presents 
this time. Specifically, one looks up one's own user ID from among the user IDs of users 
eligible for presents. 

Next, in step S820, it is decided whether said user is there. That is, it is decided 
20 whether there has been a presentation of a present to oneself If there has been a 
presentation of a present to oneself, a display of giving a present to a character is made 
on the screen of monitor 18, then, in step S822, a display is made showing the character 
210 that has obtained present 500 rejoicing, for example as shown in Figure 39. 

There is an advantage that by the user himself seeing how character 210, that 
25 provides various information to the user himself, rejoices upon receiving present 500, a 
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feeling of affinity with character 210 wells up, and this serves as motivation for 
submitting contributions. When the processing in said step S822 ends, or if in said step 
S820 it is decided that oneself is not eligible to be awarded a present, processing by this 
present processing means 312 ends. 

We return to the description of the routine in Figure 33. If in said step S509 the 
selected item is judged not to be "4. Present information", one proceeds to step S511 and 
performs other processing corresponding to the operation input. 

Submenu processing ends when the processing in said step S505, step S508, step 
S510, or step S511 ends. 

We return to the description of the main routine in Figure 24. When the 
processing in said step SI 09 or step SllO ends, one proceeds to the next step Sill, and it 
is decided whether there is a program termination request (power cutoff or forcible 
termination, etc.) to this program processing means 300. If there is no program 
termination request, one returns to aforesaid step SI 01 and repeats the processing 
beginning with said step SlOl. And upon a program termination request, the processing 
by this program processing means 300 comes to an end. 

Thus, in communication system 100 of the present invention, entertainment 
system 10 installed at each user receives from server 104, by means of first access 
processing means 302, information for constituting at least a series of programs (program 
information file 200). 

On each user's side, upon termination of processing by said first access processing 
means 302, the connection with server is interrupted, and a series of programs is 
constituted based on received program information files 200 and is displayed on monitor 
18. 

Each user can be informed of the content of the contribution submitted by each 
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user by means of the lines of dialog or placards, etc. of tlie various characters that appear 
in the series of programs that appear displayed on monitor 1 8. 

And each user, if he has information that he wants to contribute, can transfer this 
information to server 104 via second access processing means 310 either while a series of 
5 programs is continuing or after it has ended. Of course, when second access processing 
means 310 ends, the connection with server 104 is interrupted. 

In this way, in communication system 100 of the present invention, one can build 
a new mode of program distribution using a network in which one can confirm 
contributed information from users that is gathered by server 104 with the connection 

10 with server 104 interrupted and by means of a program in which various characters appear. 

In particular, because said series of programs is made to consist of multiple 
sequences having two or more time widths, said series of programs is rich in variety, 
which can prevent the user from becoming bored. Moreover, if one uses sequences that 
have continuity with each other, one can realize it as a fixed program. 

15 As the information that comprises said series of programs (program information 

files 200), one may have at least instruction information (character information CI) that 
indicates movement data that includes the conversation output of characters that appear in 
the multiple sequences constituting said series of programs, the order of said multiple 
sequences, and contributed information from users. Because all this information can be 

20 constituted as text data, the transfer speed can be improved. Moreover, if it is set up so 
that one transfers only the changed parts, the transfer speed can be raised even further, 
with the result that one can shorten the time needed for loading said program information 
files 200 by first access processing means 302. 

Also, program processing means 300 relating to this embodiment has program 

25 production means 320, which produces a series of programs based on information 
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(program information files 200) from server 104 by first access processing means 302, 
and program display means (program drawing means 322 and image display means 314), 
which output on monitor 18 the program produced by said program production means 320. 
In particular, the program display means display opening images during loading 
5 processing by first access processing means 302 and display said series of programs when 
at least said loading processing has ended. 

In this way, the user can naturally have empathy for the program without being 
aware of the loading processing of program information files 200 by entertainment system 
10. Thus the irritation of waiting through said loading processing can be eliminated. And 

10 contributed information (sequence numbers and contributed texts) that is input at an 
appropriate time during a program or after a program has ended is transferred to server 
1 04 via second access processing means 310. 

Thus, in embodiment of the present invention, in a program composition in which 
access to server 104 is a mandatory element, the user is allowed to enjoy the program 

15 without being made aware of this access, and in this way he can be made to contribute to 
the promotion of the development of new program compositions. 

Communication system 100 of the present embodiment transmits program 
information files 200 from server 104 to each user's entertainment system 10, and outputs 
to monitor 18 of entertainment system 10 a program constituted by the information 

20 registered in said program information files 200 and the information held in entertainment 
system 10. Thus, information that is mainly text data is transmitted from server 104 to 
each user, and a program can be constituted by combining, for example, image data with 
said information at each user. Because of this, the transfer speed from server 104 to each 
user can be increased, thereby eliminating the user's long wait for information sent from 

25 server 104. As a result, the effect can be obtained that the popularization of program 
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distribution using network 102 is encouraged. 

Also, in supplying programs consisting of information registered in program 
information files 200 transmitted irom server 1 04 to each user's entertainment system 1 0 
and information held in said entertainment system 10, the present embodiment has 
5 processing that produces object data of multiple characters to be displayed on monitor 1 8 
of entertainment system 10 installed at each user, processing that produces movement 
data for each sequence of multiple characters that appear in the multiple sequences, and 
processing that records on optical disk 20 distributed to each user the object data of these 
produced multiple characters and movement data for each sequence. 

1 0 In this way, first, the object data of multiple characters is produced, and movement 

data for each sequence of multiple characters that appear in multiple sequences is 
produced. The produced said multiple characters' object data and movement data for each 
sequence is recorded on optical disk 20 that is distributed to each user. 

Said optical disk 20 is distributed to each user and is installed on each user's 

15 entertainment system 10. That is, at this stage, the information recorded on optical disk 
20 is held in entertainment system 10. 

In other words, large-data-quantity character object data and movement data are 
held in each user's entertainment system 10, and in this way it becomes possible to 
transmit to each user from server 104 information that is mainly text data. Because of this, 

20 the transfer speed from server 104 to each user's entertainment system 10 can be increased, 
thereby eliminating the user's long wait for information sent from server 104. As a result, 
the effect can be obtained that the popularization of program distribution over network 
102 is encouraged. Also, a program is constituted by combining information transmitted 
from server 104 to each user and information that is held in entertainment system 10. 

25 Also, in the supply of said program information, it has processing that produces 
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multiple background image data BGD to be displayed in the multiple sequences that 
constitute said program, and processing that records on said optical disk 20 background 
image data BGD selected from the produced multiple background image data BGD. 

In this way, in a specified program, the background image can be changed 
according to various commemorative days, etc. if background image data BGD to which a 
change is to be made on various commemorative days, etc. is stored on server 104 and the 
background image data BGD that corresponds to the time is transmitted from server 104 
to each user's entertainment system 10. Because of this, the user can enjoy a program 
while being aware of a seasonal feeling or the existence of a commemorative day. And 
because the background image data BGD for different seasons does not change frequently, 
it may be held in each user's entertainment system 10. 

And because background image data BGD unrelated to seasons or 
commemorative days can be recorded on said optical disk 20, there is no need to transmit 
all the background image data BGD, and it is possible to suppress the prolongation of 
transfer time caused by the transmission of background image data BGD. 

Also, in editing program information, that is, in editing a program consisting of 
information registered in program information files 200 transmitted from server 104 to 
each user's entertainment system 10 and information held in entertainment system 10, the 
embodiment of the present invention has processing that determines the combination of 
multiple sequences that constitute said program and registers information on the 
sequences relating to this combination in program information files 200, processing that 
selects contributed texts sent from each user and extracts the contributed text to be 
announced in each sequence, and processing that registers the extracted contributed texts 
in the information of the sequence that corresponds to said contributed texts among the 
information of the multiple sequences registered in said program information files 200. 
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In this way, the multiple sequences that constitute the program are determined on 
the server 104 side, information concerning these sequences is then registered in program 
information files 200, and in addition, the contributed texts to be announced are extracted 
from the contributed texts sent from the users, and these texts to be announced are 
registered in the corresponding sequence information. 

The program information files 200 in which the various information is registered 
as described above are transmitted from server 104 to each user's entertainment system 10. 
At each user's entertainment system 10, the program is composed and displayed on 
monitor 1 8 based on information concerning sequences registered in the received program 
information files 200, and in each sequence the corresponding contributed text is 
displayed. 

In particular, in the present embodiment, when registering said extracted 
contributed texts in the information of the sequence that corresponds thereto, the feeling 
that can be judged from said contributed text may be made into flag information (feelings 
flag FFL) and registered together with said contributed text. 

In this way, when announcing a contributed text at each user, it is possible to 
announce it together with the feeling based on feelings flag FFL. That is, rather than 
simply presenting a contributed text, if the contributed text is for example of a happy 
content, it is possible for example to make a sequence content in which the characters that 
appear in the sequence present contributed texts enjoyably, and thus one can put together 
a program that one does not grow tired of. Also, the user can be made more aware of the 
contributions, thus encouraging the submission of contributions. 

Of course, the communication system, computer program execution device, 
recording medium, computer program, program information supply method, and program 
information editing method of this invention are not limited to the above embodiment, 
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and various other compositions may be adopted. 

As described above, the communication system, computer program execution 
device, recording medium, and computer program of this invention make it possible to 
confirm contributed information from users collected in a server in a state where the 
5 connection with the server is interrupted and via a program in which various characters 
appear, thereby making it possible to build a new program distribution mode using a 
network. 

Also, the method for supplying program information and the program information 
editing method of this invention make it possible to build a new program distribution 
10 mode using a network. 

While the present invention has been described at some length and with some 
particularity with respect to the several described embodiments, it is not intended that it 
should be limited to any such particulars or embodiments or any particular embodiment, 
but it is to be construed with references to the appended claims so as to provide the 
15 broadest possible interpretation of such claims in view of the prior art and, therefore, to 
effectively encompass the intended scope of the invention. 



